Information processing device

ABSTRACT

An information processing device of the present invention includes a detection means that detects the content of an image, a determination means that determines a processing mode for the image based on the result of detection of the content of the image, and an execution means that executes processing for a captured image corresponding to the processing mode.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation application of U.S. patentapplication Ser. No. 17/422,043 filed on Jul. 9, 2021, which is aNational Stage Entry of international application PCT/JP2019/001465,filed on Jan. 18, 2019, the disclosures of all of which are incorporatedin their entirety by reference herein.

TECHNICAL FIELD

The present invention relates to an information processing device thatcontrols processing for a captured image of a target place, aninformation processing method, and a program.

BACKGROUND ART

In places where a large number of unspecified persons gather such as anairport, a station, a store, and an event venue, a surveillance camerafor detecting the action of a person and the person himself/herself isinstalled. From an image captured by the surveillance camera, processingis performed, for example, detection of the movement condition of acrowd including a large number of persons and detection of a previouslyregistered person by face authentication.

As an example, Patent Document 1 describes detecting a target objectfrom an input image captured by a camera and extracting a feature value.To be specific, Patent Document 1 describes assessing and selecting adetection method and an extraction method for an input image per time.

-   Patent Document 1: International Application Publication No.    2014/155639

However, in the technique of Patent Document 1 described above, onlyswitching processing for an input image per time is performed. For thisreason, it is impossible to perform processing for an input imageefficiently and appropriately. As a result, there arises a problem thatit is impossible to efficiently utilize an image capturing deviceinstalled for taking an input image.

SUMMARY OF THE INVENTION

Accordingly, an object of the present invention is to solve theabovementioned problem that it is impossible to efficiently utilize animage capturing device.

An information processing device according to an aspect of the presentinvention includes: a detection means that detects a content of acaptured image; a determination means that determines a processing modefor the captured image based on a result of detection of the content ofthe captured image; and an execution means that executes processing forthe captured image, the processing corresponding to the processing mode.

Further, a computer program according to another aspect of the presentinvention includes instructions for causing an information processingdevice to realize: a detection means that detects a content of acaptured image; a determination means that determines a processing modefor the captured image based on a result of detection of the content ofthe captured image; and an execution means that executes processing forthe captured image, the processing corresponding to the processing mode.

Further, an information processing method according to another aspect ofthe present invention includes: detecting a content of a captured image;determining a processing mode for the captured image based on a resultof detection of the content of the captured image; and executingprocessing for the captured image, the processing corresponding to theprocessing mode.

With the configurations as described above, the present invention allowsfor efficient use of an image capturing device.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a view showing the entire configuration of an informationprocessing system according to a first example embodiment of the presentinvention;

FIG. 2 is a view showing the entire configuration of the informationprocessing system according to the first example embodiment of thepresent invention;

FIG. 3A is a block diagram showing the configuration of a monitoringdevice disclosed in FIG. 1 ;

FIG. 3B is a view showing an example of information stored in adetermination criteria storage part of the monitoring device disclosedin FIG. 3A;

FIG. 4 is a view showing how control processing is performed by themonitoring device disclosed in FIG. 1 ;

FIG. 5 is a view showing how control processing is performed by themonitoring device disclosed in FIG. 1 ;

FIG. 6 is a view showing how control processing is performed by themonitoring device disclosed in FIG. 1 ;

FIG. 7 is a view showing how control processing is performed by themonitoring device disclosed in FIG. 1 ;

FIG. 8 is a flowchart showing a processing operation by the monitoringdevice disclosed in FIG. 1 ;

FIG. 9 is a view showing how monitoring a captured image is performed bythe monitoring device disclosed in FIG. 1 ;

FIG. 10 is a view showing how monitoring a captured image is performedby the monitoring device disclosed in FIG. 1 ; and

FIG. 11 is a block diagram showing the configuration of an informationprocessing device in a second example embodiment of the presentinvention.

EXAMPLE EMBODIMENT First Example Embodiment

A first example embodiment of the present invention will be describedwith reference to FIGS. 1 to 10 . FIGS. 1 to 7 are views for describingthe configuration of an information processing system. FIGS. 8 to 10 areviews for describing a processing operation of the informationprocessing system.

[Configuration]

The information processing system according to the present invention isa system that controls a camera C serving as an image capturing deviceinstalled in a target place indoors or outdoors and controls processingfor a captured image. In this example embodiment, an informationprocessing system that includes a plurality of cameras C installed in astadium S, which is a target place, where events such as a sport and aconcert are held will be described as an example. However, theinformation processing system according to the present invention may beused in any place.

As shown in FIG. 1 , the cameras C configuring the informationprocessing system include an internal camera that captures images of theinside of the stadium S as a target place, namely, captures images of aplace where an event is held such as the ground and a stand, and anexternal camera that captures images of the outside of the stadium S,namely, captures images of the vicinity of an entrance/exit gate and thesurroundings of the stadium. FIG. 2 illustrates the camera C thatcaptures images of the vicinity of an entrance/exit gate G. However, aplace to install the camera C is not limited to the abovementionedplace.

As shown in FIGS. 1 and 2 , the information processing system in thisexample embodiment includes a monitoring device 10 connected to thecameras C, and an output device 20 and an information provision device30 that are connected to the monitoring device 10. The monitoring device10 executes analysis processing on a captured image captured by thecamera C and control processing for the camera C. The output device 20outputs a captured image and also outputs the result of processingexecuted by the monitoring device 10. The information provision device30 provides various kinds of information such as the progress status ofan event held in the stadium S and the weather information of thevicinity of the stadium S. Below, the respective components will bedescribed in detail.

The monitoring device 10 is configured by one or a plurality ofinformation processing devices each including an arithmetic logic unitand a storage unit. As shown in FIG. 3A, the monitoring device 10includes a video detection part 11, an information acquisition part 12,a processing mode determination part 13, and a control part 14 that areconstructed by the arithmetic logic unit executing a program. Moreover,the monitoring device 10 includes a determination criteria storage part16 formed in the storage unit.

First, the video detection part 11 (detection means) receives capturedimages captured by the camera C at predetermined time intervals. Forexample, as shown in FIG. 2 , the video detection part 11 receives acaptured image captured by the camera C installed in the vicinity of theentrance/exit gate G from this camera C. Then, from the shape, color,motion and so on of an object shown in the captured image, the videodetection part 11 detects the content of the captured image,specifically in this example embodiment, detects the condition ofpersons P in the captured image (step S1 in FIG. 8 ). For example, thevideo detection part 11 detects the number, density and movementdirection of the persons P detected from the captured image. Then, thevideo detection part 11 notifies the detected condition of the persons Pto the processing mode determination part 13.

The information acquisition part 12 acquires various kinds ofinformation such as the progress status of an event being held in thestadium S and the weather information of the vicinity of the stadium Sfrom the information provision device 30 connected to the monitoringdevice 10 via a network (step S2 in FIG. 8 ). To be specific, theinformation acquisition part 12 acquires information such as before thestart of the game, during the game, and after the end of the game as theprogress status of a game (match) being played in the stadium S, andweather information such as sunny, rainy, and temperature as the currentweather information of the vicinity of the stadium S. Then, theinformation acquisition part 12 notifies the acquired information to theprocessing mode determination part 13.

Meanwhile, the video detection part 11 may detect the game progressstatus and the weather information mentioned above based on the contentof the captured image captured with the camera C and notify the detectedinformation to the processing mode determination part 13. For example,the video detection part 11 detects the number of the persons P on theground, the presence/absence of a referee, motion, and so on based onthe captured image captured with the camera C in the stadium S, anddetects whether the progress status of the game is before the start ofthe game, during the game, or after the end of the game from thedetected content. Besides, the video detection part 11 detects whetherthe person P as a spectator in the captured image is using an umbrella,noise of the image due to rain, and so on, and detects the weatherinformation such as sunny or rainy from the detected content. The videodetection part 11 may detect various kinds of information of the stadiumS such as the above-described progress status and weather informationfrom the video image by any method.

Based on the result of detection of the content of the captured imagenotified from the video detection part 11 and the information notifiedfrom the information acquisition part 12, the processing modedetermination part 13 (determination means) determines a processing modeto be executed for the captured image (step S3 in FIG. 8 ).Determination criteria for determining a processing mode based on theresult of detection of the content of the captured image and theinformation received from the information acquisition part 12 are storedin the determination criteria storage part 15 of the monitoring device10. Therefore, the processing mode determination part 13 determines aprocessing mode using the determination criteria.

A processing mode to be executed for a captured image includes analysisprocessing for a captured image and control processing for the camera Cfor capturing an image. Furthermore, specifically, analysis processingfor a captured image includes crowd detection processing, actiondetection processing, and face authentication processing on a personshown in a captured image. Control processing for the camera C includescontrol processing such as operation/stop, zoom, field angle switchingand movement of the camera.

For example, as shown in FIG. 3B, the determination criteria describedabove are stored in association with processing modes. In the example ofFIG. 3B, a determination criterion for a captured image or acquiredinformation, an area (camera) that is the target of a processing mode tobe determined, and a processing mode to be determined (analysisprocessing and control processing) are associated with each other.

A specific example of determination processing by the processing modedetermination part 13 will be described. In this example, a case where adetermination criterion No. 1 shown in FIG. 3B is applied will bedescribed. When receiving information representing the number or densityof the persons P shown in a captured image as the content of thecaptured image from the camera C installed in the vicinity of theentrance/exit gate G, the processing mode determination part 13 checkswhether or not the number or density of the persons exceeds a thresholdfor determining as a crowd. When the number or density of the personsexceeds the threshold as shown in FIG. 4 , the processing modedetermination part 13 determines a processing mode for a captured imagecaptured by the camera C in the vicinity of the entrance/exit gate G tobe analysis processing of “crowd detection processing” (Yes at step S4,step S5 in FIG. 8 ). Crowd detection processing is processing fordetecting whether a crowd is formed by the persons in a captured imagecaptured by the camera C, the movement direction and moving speed of thecrowd, and so on, and is executed by an analysis engine E connected tothe monitoring device 10. Besides, when the number or density of thepersons exceeds the threshold and the processing mode is determined tobe analysis processing of the “crowd detection processing”, theprocessing mode determination part 13 also determines to perform zoomcontrol processing for the camera C in the vicinity of the entrance/exitgate G (Yes at step S6, step S7 in FIG. 8 ). That is to say, in thiscase, the processing mode determination part 13 determines to performzoom-down control so as to be able to capture a whole image in order tofacilitate the crowd detection processing for the captured image.

Further, as an example, a case where a determination criterion No. 2shown in FIG. 3B is applied will be described. When the number ordensity of the persons P shown in a captured image received from thecamera C installed in the vicinity of the entrance/exit gate G is equalto or less than a threshold as shown in FIG. 5 in contrast with theabovementioned case, the processing mode determination part 13determines a processing mode for the camera C to be analysis processingof “face authentication processing”. Face authentication processing isauthentication processing for extracting a feature value from a faceimage of a person in a captured image and checking whether the faceimage agrees with a previously registered face image, and is executed bythe analysis engine E connected to the monitoring device 10. Moreover,when the number or density of the persons is equal to or less than thethreshold and the processing mode is determined to be analysisprocessing of the face authentication processing, the processing modedetermination part 13 also determines to perform zoom control processingfor the camera C in the vicinity of the entrance/exit gate G. That is tosay, in this case, the processing mode determination part 13 determinesto perform zoom-up control so as to be able to capture a close image inorder to facilitate acquisition of a face image of the person in thecaptured image.

Further, as an example, a case where a determination criterion No. 3, 4or 5 shown in FIG. 3B is applied will be described. When receivinginformation representing the progress status of an event held in thestadium S from the information acquisition part 12, the processing modedetermination part 13 checks the content of the progress status. Then,the processing mode determination part 13 determines a processing modein accordance with the progress status of the event. For example, whenthe progress status is “before start of game”, the processing modedetermination part 13 determines a processing mode for a captured imagecaptured by the camera C in the vicinity of the entrance/exit gate G tobe “face authentication processing”, and also determines a processingmode for the camera C to be “zoom-up control”. When the progress statusis “during game”, the processing mode determination part 13 determines aprocessing mode for a captured image captured by the camera C in thevicinity of the entrance/exit gate G to be “action detectionprocessing”, and also determines a processing mode for the camera C tobe “zoom-down control”. When the progress status is “after end of game”,the processing mode determination part 13 determines a processing modefor a captured image captured by the camera C in the vicinity of theentrance/exit gate G to be “crowd detection processing”, and alsodetermines a processing mode for the camera C to be “zoom-down control”.The abovementioned “action detection processing” is analysis processingfor detecting a person who is taking a specific action such as asuspicious action or a stagger from the flow lines or motions of thepersons P in the captured image, and is executed by the analysis engineE connected to the monitoring device 10.

Further, as an example, a case where the processing mode determinationpart 13 determines a processing mode based on both the content of acaptured image and information of a target place will be described. Inthis case, “progress status: before start of game” and “image capturedby camera 1: number/density of persons≤threshold” are set asdetermination criteria, and “face authentication processing” and“zoom-up” are set as processing modes corresponding to the above. Whenthe progress status is before the start of a game and the number ordensity of the persons P in a captured image captured by the camera C inthe vicinity of the entrance/exit gate G is equal to or less than athreshold, the processing mode determination part 13 determines aprocessing for the captured image captured by the camera C to beanalysis processing of the “face authentication processing”, anddetermines a processing mode for the camera C to be “zoom-up control”.Moreover, as another example, when the progress status is before thestart of a game and the number or density of the persons P in thecaptured image captured by the camera C in the vicinity of theentrance/exit gate G exceeds the threshold, the processing modedetermination part 13 determines a processing mode for the capturedimage captured by the camera C to be analysis processing of the “crowddetection processing” and determines a processing mode for the camera Cto be “zoom-down control”.

Further, as an example, a case where a determination criterion No. 6shown in FIG. 3B is applied will be described. The processing modedetermination part 13 checks from the progress status of an event of thestadium S whether the event is being held in the stadium S. For example,the processing mode determination part 13 collects information on theprogress status of the event such as a timetable, a period of timeelapsed after the start of the event, and the actions (left or seated)of the spectators analyzed from the captured image, and checks whetherthe event has not been held or has ended or in another progress status(being held, on break, etc.). In the case of detecting that the event isnot being held, the processing mode determination part 13 determines aprocessing mode of controlling operation/stop of the camera C or theanalysis engine. For example, as indicated by a cross mark in FIG. 6 ,the processing mode determination part 13 determines a processing modefor the camera C in the vicinity of the entrance/exit gate G to be“stop”, and stops capturing an image. Moreover, as indicated by thecross mark in FIG. 6 , the processing mode determination part 13determines a processing mode for part of the cameras C capturing animage of the inside of the stadium S to be “stop” and determines aprocessing mode for the remaining cameras C to be “action detectionprocessing”, and also determines a processing mode for these cameras Cto be “zoom-down control”. With this, it is possible to detect anillegal intruder in the stadium S while restricting the number of theoperating cameras.

Further, as an example, a case where a determination criterion No. 7shown in FIG. 3B is applied will be described. When receiving weatherinformation around the stadium S from the information acquisition part12, the processing mode determination part 13 checks the content of theweather. Then, the processing mode determination part 13 determines aprocessing mode in accordance with a weather condition. For example,when the weather around the stadium S is “sunny”, the processing modedetermination part 13 determines a processing mode for a captured imagecaptured by the camera C in the stadium S to be “action detectionprocessing”, and also determines a processing mode for the camera C tobe “zoom-down control”. On the other hand, as an example where anotherdetermination criterion is applied, when the weather around the stadiumS is “rainy”, the processing mode determination part 13 determines aprocessing mode for only part of the cameras C capturing an image of theinside of the stadium S to be “stop” as shown in FIG. 7 , and stopsanalysis processing for the captured image. This is because it isanticipated that more spectators put up umbrellas due to rain and hencethe processing accuracy of the action detection processing will getlower, so that the processing mode determination part 13 stops capturingan image and the analysis processing. As an example in which stillanother criterion is applied, when the temperature around the stadium Sis high and is equal to or more than a threshold, the processing modedetermination part 13 determines a processing mode for a captured imagecaptured by the camera C in the stadium S to be “action detectionprocessing”, and also determines a processing mode for the camera C tobe “zoom-up control”. With this, it is possible to detect a spectator inthe stadium S in a bad physical condition, for example, a spectator whois staggering. As described above, when the video detection part 11detects the progress status of an event or weather information aroundthe stadium S from the content of a captured image, the processing modedetermination part 13 may determine a processing mode based on theprogress status of the event and the weather information notified fromthe video detection part 11.

In the above description, the processing mode determination part 13determines to execute one kind of analysis processing on a capturedimage of one area (camera). However, the processing mode determinationpart 13 may determine to execute multiple kinds of analysis processingon a captured image of one area (camera). That is to say, as indicatedby a determination criterion No. 8 of FIG. 3B, regarding a determinationcriterion “number/density of persons≤threshold 2”, multiple kinds ofanalysis processing “face authentication processing” and “crowddetection processing” may be associated with an area 1 (camera 1). Inthis case, both the kinds of analysis processing “face authenticationprocessing” and “crowd detection processing” are executed on a capturedimage of the area 1 (camera 1). In a case where one analysis processing“face authentication process” is set to be “prior” as indicated by thedetermination criterion No. 8 of FIG. 3B, the processing modedetermination part 13 determines to execute “face authenticationprocessing” in prior to “crowd detection processing”. In this case,“face authentication processing” is executed by the analysis engine Eearlier in order than “crowd detection processing”, or more resourcessuch as CPU of the analysis engine E are assigned to “faceauthentication processing” than “crowd detection processing”. In a casewhere the resources are a little, only “face authentication processing”is executed. Besides, for “face authentication processing”, the numberof frames of a captured image to be used is more than for “crowddetection processing”, or processing is executed in higher image qualitythan for “crowd detection processing”. Thus, the processing modedetermination part 13 may determine the processing level of a processingmode.

Further, in the above description, the processing mode determinationpart 13 determines a processing mode for each area (camera). However,the processing mode determination part 13 may determine a processingmode for each of the division regions obtained by dividing an area,namely, an image captured by the camera C into a plurality of regions.For example, the processing mode determination part 13 may determine aprocessing mode for a left half region of a captured image to be “faceauthentication processing” because the left half region satisfies thedetermination criterion “number/density≤threshold”, and may determine aprocessing mode for a right half region of the captured image to be“crowd authentication processing” because the right half regionsatisfies the determination criterion “number/density>threshold”.Meanwhile, the processing mode determination part 13 may determine aprocessing mode for the left half region of the captured image to be“face authentication processing” and determine no processing mode forthe right half region of the captured image. In this case, theprocessing mode determination part 13 may determine a processing modefor the camera C to be “zoom-up control” so as to correspond to “faceauthentication processing” for the left half region. Besides, in a casewhere a person shown in the left half region of the captured image forwhich a processing mode has been determined to be “face authenticationprocessing” has moved, the processing mode determination part 13 maychange and set a region for which a processing mode has been determinedto be “face authentication processing” in accordance with the movementof the person. Thus, for each region of a captured image, the processingmode determination part 13 may check whether or not the region satisfiesthe determination criterion and determine a process mode.

In the above description, a case where the processing mode determinationpart 13 detects, as the content of a captured image, the “number ordensity” of persons shown in the captured image and determines aprocessing mode has been described. However, the processing modedetermination part 13 may detect the content of a captured image asshown below and determine a processing mode. For example, the processingmode determination part 13 may detect the movement direction of a personshown in a captured image, and determine a processing mode to be theface authentication processing when the person is moving toward thecamera and determine a processing mode to be whole-body authenticationprocessing when the person is moving away. Whole-body authenticationprocessing is person authentication processing with a whole-body imageincluding the cloths, hair style, silhouette, belongings and so on of aperson. Moreover, for example, the processing mode determination part 13may detect a face region of a person shown in a captured image, anddetermine a processing mode to be the face authentication processingwhen a face size exceeds a predetermined value and determine aprocessing mode to be the whole-body authentication processing when theface size is equal to or less than the predetermined value. Moreover,for example, the processing mode determination part 13 may detect theaction of a person shown in a captured image and, when detecting aspecific action (e.g., the person is swinging something, is wrestlingwith someone, or falls), determine a processing mode to be controlprocessing of zooming up the camera. However, the content of a capturedimage used when the processing mode determination part 13 determines aprocessing mode is not limited to the abovementioned ones.

In the examples using the information of FIG. 3B described above, theprocessing mode determination part 13 determines a processing modedepending on whether or not one kind of information among the content ofa captured image, the progress status of an event and weatherinformation satisfies its determination criterion. However, in a casewhere multiple kinds of information satisfy their determinationcriteria, the processing mode determination part 13 may determine aprocessing mode associated with these determination criteria. That is tosay, in a case where one kind of information among the content of acaptured image, the progress status of an event and weather informationsatisfies its determination criterion or two or three kinds ofinformation among the above satisfy their determination criteria, theprocessing mode determination part 13 may determine a processing modeassociated with the determination criterion/criteria. To be specific, ina case where the content of a captured image and the progress status ofan event, or the content of a captured image and weather information, orthe progress status of an event and weather information, or the contentof a captured image, the progress status of an event and weatherinformation satisfy their determination criteria, the processing modedetermination part 13 may determine a processing mode associated withthese determination criteria. Furthermore, at this time, the processingmode determination part 13 may determine a processing mode depending onwhether or not multiple pieces of information in one kind satisfy thedetermination criteria. For example, in a case where, of the content ofa captured image, the number/density of persons and the movementdirection of a person satisfy the determination criteria, the processingmode determination part 13 may determine a processing mode associatedwith the determination criteria. Besides, in the examples of FIG. 3B, acase of determining a processing mode to be only “analysis processing”and a case of determining both “analysis processing” and “camera controlprocessing” have been described. However, the processing modedetermination part 13 may determine only “camera control processing”.

The control part 14 (notification means, execution means) first outputsthe processing mode determined as described above through the outputdevice 20, thereby notifying to the outside. Moreover, the control part14 executes processing for to the captured image corresponding to thedetermined processing mode (step S8 in FIG. 8 ). That is to say, inaccordance with the determined processing mode, the control part 14executes operation/stop control and zoom control for the camera C, andcontrols the respective analysis engines E to execute various kinds ofanalysis processing on the captured image. Furthermore, the control part14 outputs the processing result of the executed analysis processingthrough the output device 20. With this, a guard of the stadium S canrecognize a processing mode to be executed and also recognize the resultof processing.

An example of when the abovementioned control part 14 outputs throughthe output device 20 how analysis processing is executed on a capturedimage is described in FIGS. 9 and 10 . First, as shown in FIG. 9 , theoutput device 20 displays an image display region 21 for displaying acaptured image, a camera name display region 22 for displaying the nameof a camera capturing the captured image displayed in the screen displayregion 21, an analysis processing name display region 23 for displayingthe name of analysis processing executed on the captured image, anannounced analysis processing name display region 24 for displaying thename of analysis processing to which processing is switched, and a stopbutton 25.

The example of FIG. 9 shows how the “face authentication processing” isexecuted on a captured image captured by the camera C of a “gate camera1”. At this time, the whole captured image may be output in the wholeregion of the image display region 21. However, in this example, areduced whole captured image 21 a is displayed in the upper left corner,and a part 21 b of the captured image 21 a is enlarged and displayed inthe whole image display region 21. The enlarged image 22 b is displayshowing the processing result of the face authentication processingexecuted on the captured image 21 a, specifically, an enlarged image ofa region where a person who answers a previously registered person isfound by face authentication. At this time, in the enlarged image 21 b,the face portion of the person who answers the registered person as aresult of the face authentication processing is displayed in anemphasized manner. For example, the person who answers the registeredperson is blacked and the face portion of this person is boxed.Meanwhile, in a case where the face authentication processing isexecuted and a person who answers a registered person is not found, thewhole captured image is displayed in the image display region 21 asshown in FIG. 10 .

While the face authentication processing is executed on a captured imageas described above, the processing mode determination part 13 performsdetermination of a new processing mode. That is to say, in a case wherethe content of a captured image, the progress status of an event, orweather information satisfies another determination criterion, theprocessing mode determination part 13 determines another processing modeassociated with the other determination criterion. Then, the controlpart 14 displays/outputs the newly determined other processing mode inthe announced analysis processing name display region 24, and switchesthe processing mode to a new processing mode after a certain time. Forexample, in the example of FIG. 10 , the number of persons in a capturedimage has increased and the number/density of the persons has exceeded athreshold, so that the processing mode determination part 13 determinesthe analysis processing of the processing mode to be the “crowddetection processing” and displays it in the announced analysis namedisplay region 24. At this time, in the case of desiring to switch tothe “crowd detection processing”, an operator operating the outputdevice 20 pushes the stop button 25. With this, the control part 14 doesnot switch analysis processing for the captured image to the “crowddetection processing” and keeps executing the “face authenticationprocessing”. Meanwhile, after “crowd detection processing” is displayedin the announced analysis process name display region 24 and a certaintime passes without the stop button 25 being pressed, the control part14 switches the analysis processing for the captured image to the “crowddetection processing”.

In a case where the operator wants to set a desired processing mode(analysis processing) for a captured image, the operator can select thedesired analysis processing from a pulldown menu of the analysisprocessing name display region 23. Then, the control part 14 switchesthe analysis processing to the selected analysis processing. Thus, forexample, when the control part 14 switches analysis processing, it ispossible to execute desired analysis processing, for example, it ispossible to return the analysis processing to the one before switchingand execute it.

Further, when the operator pushes the stop button 25 or selects desiredanalysis processing from the pulldown menu of the analysis process namedisplay region 23 as described above, the control part 14 acquiresinformation including the content of a captured image, the progressstatus of an event, and weather condition. Then, the control part 14learns so as to associate the acquired information with the analysisprocessing of the processing mode before switching and the selectedanalysis processing. That is to say, the control part 14 may considerthe acquired information including the content of the captured image,the progress status of the event and the weather condition to bedetermination criteria, and associate the determination criteria withthe analysis processing before switching and the selected analysisprocessing, thereby generating new determination criteria information.

In the example shown in FIGS. 9 and 10 , a captured image captured bythe single camera C and the result of analysis processing executed onthe captured image are largely displayed in the image display region 21.However, a plurality of captured images captured by a plurality ofcameras C and the results of the analysis processing may be displayed inthe image display region 21.

Thus, the information processing system according to the presentinvention can control the status of capturing an image by the camera Cinstalled in a target place such as the stadium S and analysisprocessing executed on a captured image, depending on the condition ofthe target place. With this, the guard can recognize a processing modeexecuted depending on the condition and a processing result, andpromptly take measures in accordance with the processing result. As aresult, it is possible to efficiently use the camera C installed in thetarget place.

In the above description, the condition of persons shown in a capturedimage is detected as the content of a captured image, and a processingmode for the captured image is determined based on the condition of thepersons. However, a processing mode may be determined based on theresult of detection of any content in a captured image. For example,when an action such as leaving an object by a person is detected or ananimal is detected in a captured image, a processing mode may bedetermined so as to execute control processing such as zoom-up of thecamera C and analysis processing such as object detection processing.Moreover, in the above description, a processing mode for a capturedimage is determined based on weather information or the progress statusof an event of a target place. However, a processing mode may bedetermined based on any information of a target place. Furthermore, inthe above description, the content of analysis processing executed on acaptured image or the content of control processing executed on an imagecapturing device are determined as a processing mode to be determined.However, another processing mode may be determined as long as it isprocessing for a captured image.

Second Example Embodiment

Next, a second example embodiment of the present invention will bedescribed with reference to FIG. 9 . FIG. 9 is a block diagram showingthe configuration of an information processing device in the secondexample embodiment. In this example embodiment, the overview of theconfiguration of the monitoring device described in the first exampleembodiment.

As shown in FIG. 9 , an information processing device 100 in thisexample embodiment includes: a detection means 120 that detects contentof a captured image; a determination means that, based on a result ofdetection of content of a captured image, determines a processing modefor the captured image; and an execution means 130 that executesprocessing for a captured image corresponding to a processing mode.

The detection means 110, the determination means 120, and the executionmeans 130 that are described above may be constructed by an arithmeticlogic unit of the information processing device 100 executing a program,or may be constructed by an electronic circuit.

Then, the information processing device 100 with the above configurationoperates so as to execute processing for: detecting content of acaptured image; based on a result of detection of content of a capturedimage, determining a processing mode for image; and executing processingfor a captured image corresponding to a processing mode.

According to the present invention, in accordance with the content of animage captured by an image capture device installed in a target place,executes a process relating to a captured image corresponding to theprocessing mode. With this, it is possible to execute a process relatingto a captured image in accordance with the condition of a target place,and it is possible to efficiently use an image capture device installedin a target place.

<Supplementary Notes>

The whole or part of the example embodiments disclosed above can bedescribed as in the following supplementary notes. Below, the overviewof the configurations of the information processing device, theinformation processing method and the program according to the presentinvention will be described. However, the present invention is notlimited to the following configurations.

(Supplementary Note 1)

An information processing device comprising:

-   -   a detection means that detects a content of a captured image;    -   a determination means that determines a processing mode for the        captured image based on a result of detection of the content of        the captured image; and    -   an execution means that executes processing for the captured        image, the processing corresponding to the processing mode.

(Supplementary Note 2)

The information processing device according to Supplementary Note 1,wherein:

-   -   the detection means detects a status of a person in the captured        image; and    -   the determination means determines the processing mode based on        the condition of the person in the captured image.

(Supplementary Note 3)

The information processing device according to Supplementary Note 1 or2, wherein:

-   -   the determination means determines an analysis processing mode        representing a content of analysis processing on the captured        image as the processing mode, based on the result of detection        of the content of the captured image; and    -   the execution means executes analysis processing on the captured        image, the analysis processing corresponding to the analysis        processing mode.

(Supplementary Note 4)

The information processing device according to Supplementary Note 3,wherein:

-   -   the detection means detects a number or density of persons in        the captured image; and    -   the determination means determines the analysis processing mode        based on a result of detection of the number or density of the        persons in the captured image.

(Supplementary Note 5)

The information processing device according to Supplementary Note 3 or4, wherein:

-   -   the detection means detects an action of the person in the        captured image; and    -   the determination means determines the analysis processing mode        based on a result of detection of the action of the person in        the captured image.

(Supplementary Note 6)

The information processing device according to any of SupplementaryNotes 1 to 5, wherein the determination means determines an analysisprocessing mode representing a content of analysis processing on thecaptured image as the processing mode, based on the result of detectionof the content of the captured image, and also determines controlprocessing on an image capturing device for capturing the capturedimage, the control processing corresponding to the analysis processingmode.

(Supplementary Note 7)

The information processing device according to any of SupplementaryNotes 1 to 6, wherein the determination means determines, as theprocessing mode, any of crowd detection processing, action detectionprocessing and face authentication processing on the person in thecaptured image.

(Supplementary Note 8)

The information processing device according to any of SupplementaryNotes 1 to 7, wherein the determination means determines controlprocessing on an image capturing device for capturing the capturedimage, as the processing mode.

(Supplementary Note 9)

The information processing device according to any of SupplementaryNotes 1 to 8, wherein the determination means determines the processingmode based on the result of detection of the content of the capturedimage and information output in association with a place where thecaptured image has been captured.

(Supplementary Note 10)

The information processing device according to Supplementary Note 9,wherein the determination means determines the processing mode based oninformation representing a progress status of an event being held in aplace where the captured image is being captured.

(Supplementary Note 11)

The information processing device according to Supplementary Note 9 or10, wherein the determination means determines the processing mode basedon weather information of a place where the captured image is beingcaptured.

(Supplementary Note 12)

The information processing device according to any of SupplementaryNotes 1 to 11, further comprising a notification means that notifies theprocessing mode to outside.

(Supplementary Note 13)

A computer program comprising instructions for causing an informationprocessing device to realize:

-   -   a detection means that detects a content of a captured image;    -   a determination means that determines a processing mode for the        captured image based on a result of detection of the content of        the captured image; and    -   an execution means that executes processing for the captured        image, the processing corresponding to the processing mode.

(Supplementary Note 14)

An information processing method comprising:

-   -   detecting a content of a captured image;    -   determining a processing mode for the captured image based on a        result of detection of the content of the captured image; and    -   executing processing for the captured image, the processing        corresponding to the processing mode.

(Supplementary Note 15)

The information processing method according to Supplementary Note 14,wherein:

-   -   a status of a person in the captured image is detected as the        content of the captured image; and    -   the processing mode is determined based on the condition of the        person in the captured image.

(Supplementary Note 16)

The information processing method according to Supplementary Note 14 or15, wherein:

-   -   an analysis processing mode representing a content of analysis        processing on the captured image is determined as the processing        mode, based on the result of detection of the content of the        captured image; and    -   analysis processing corresponding to the analysis processing        mode is executed on the captured image.

(Supplementary Note 17)

The information processing method according to any of SupplementaryNotes 14 to 16, wherein control processing on an image capturing devicefor capturing the captured image is determined as the processing mode.

(Supplementary Note 18)

The information processing method according to any of SupplementaryNotes 14 to 17, wherein the processing mode is determined based on theresult of detection of the content of the captured image and informationoutput in association with a place where the captured image has beencaptured.

The above program is stored using various types of non-transitorycomputer-readable mediums, and can be supplied to the computer. Thenon-transitory computer-readable medium includes various types oftangible recording mediums. Examples of the non-transitorycomputer-readable medium include a magnetic recording medium (forexample, a flexible disk, a magnetic tape, a hard disk drive, etc.), amagneto-optical recording medium (a magneto-optical disk, etc.), aCD-ROM (Read Only Memory), a CD-R, a CD-R/W, and a semiconductor memory(a mask ROM, a PROM (Programmable ROM), an EPROM (Erasable PROM), aflash ROM, and a RAM (Random Access Memory)). The program may besupplied to the computer by various types of transitorycomputer-readable mediums. Examples of the transitory computer-readablemedium include an electric signal, an optical signal, and anelectromagnetic wave. The transitory computer-readable medium can supplythe program to the computer via a wired communication path such as anelectric wire and an optical fiber, or via a wireless communicationpath.

Although the present invention has been described above with referenceto the example embodiments and so on, the present invention is notlimited to the above example embodiments. The configurations and detailsof the present invention can be changed in various manners that can beunderstood by one skilled in the art within the scope of the presentinvention.

DESCRIPTION OF REFERENCE NUMERALS

-   -   10 monitoring device    -   11 video detection part    -   12 information acquisition part    -   13 processing mode determination part    -   14 control part    -   15 determination criteria storage part    -   20 output device    -   30 information provision device    -   100 information processing device    -   110 detection means    -   120 determination means    -   130 execution means    -   C camera    -   E analysis engine    -   G entrance/exit gate    -   P person    -   S stadium

1. An information processing device comprising: a memory in whichinstructions are stored; and at least one processor configured toexecute the instructions, wherein the instructions include: receiving acaptured image; acquiring information related to a progress status of anevent, the event being held in a place where the captured image has beencaptured; determining a processing mode for the captured image based onthe progress status of the event; and executing processing for thecaptured image, the processing corresponding to the processing mode. 2.The information processing device according to claim 1, wherein theinstructions include: detecting number, kind and motion of persons basedon the captured image; and acquiring the information related to theprogress status of the event by detecting from the detected contentbased on the captured image.
 3. The information processing deviceaccording to claim 1, wherein the instructions include: acquiring theinformation related to the progress status of the event, the informationincluding a timetable, a period of time elapsed after start of theevent, and motions of persons in the captured image; detecting whetherthe event has not been held, has ended, or being held.
 4. Theinformation processing device according to claim 3, wherein theinstructions include: when the event has not been held is detected,determining the processing mode for a camera to be stop, the cameracapturing the image.
 5. The information processing device according toclaim 3, wherein the instructions include: when the event has not beenheld is detected, determining the processing mode for part of severalcameras to be stop, and determining the processing mode for remaining ofthe several cameras to be action detection processing, the severalcamera capturing the image.
 6. The information processing deviceaccording to claim 3, wherein the instructions include: detecting theprocessing mode for the remaining of the several cameras to be zoom-downcontrol.
 7. An information processing method comprising: receiving acaptured image; acquiring information related to a progress status of anevent, the event being held in a place where the captured image has beencaptured; determining a processing mode for the captured image based onthe progress status of the event; and executing processing for thecaptured image, the processing corresponding to the processing mode. 8.A non-transitory computer-readable storage medium storing a program, theprogram comprising instructions for causing an information processingdevice to execute: a process to receive a captured image; a process toacquire information related to a progress status of an event, the eventbeing held in a place where the captured image has been captured; aprocess to determine a processing mode for the captured image based onthe progress status of the event; and a process to execute processingfor the captured image, the processing corresponding to the processingmode.